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ABSTRACT 



A method for providing force feedback over a network 
supporting TCP/IP protocols by: (a) sending from a client 
computer over a network supporting TCP/IP protocols, a 
connection request to a web server connected to the network 
that is hosting a desired URL; (b) receiving and processing 
an HTML file at the client computer that was sent from the 
web server in response to the connection request, wherein 
the processing includes parsing an embedded force object 
reference having associated parameters and building a force 
object therefrom; (c) developing a force feedback signal 
wdth the force object; and (d) providing force feedback to a 
human/computer interface device coupled to the client com- 
puter in response to the force feedback signal. A networked 
force feedback system of the present invention includes a 
network, a first computer coupled to the network, and a 
second computer coupled to the network, where the second 
computer includes a visual display and a human/computer 
interface device capable of providing a second computer 
input and providing force feedback in response to a force 
feedback signal provided by the second computer. The 
second computer develops an image on the visual display 
that is associated with stored feedback information, such 
that the second computer produces the force feedback signal 
in response to at least one of information derived from the 
first computer and of the second computer input. 

40 Claims, 11 Drawing Sheets 
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FORCE FEEDBACK PROVIDED OVER A users to navigate through and interact as "avatars" in such an 

COMPUTER NETWORK environment using a client computer system. 

The Internet and the WWW also pennit sound data to be 

This is a Continuation application of prior application transmitted over the Internet. For example, references to 

Ser. No. 08/691,852 filed on Aug. 1, 1996 now U.S. Pat. No. 5 sound files can be embedded in HTML pages and can be 

5,956,484, which is a continuation-in-part of prior applica- played by the web browser. Data "packets" coded in TCP/IP 

tion Ser. No. 08/571,606, filed on Dec. 13, 1995, the format can also be sent from one client machine to another 

disclosures of which are incorporated herein by reference. over the Internet to transmit sound data. This last-mentioned 

BACKGROUhTO OF THE INVENTION :o '^^^^'''^^f""^ "^^.^^'^ '^'^P^^^y- 

While the transmission of visual images (both static and 

This invention relates generally to human/computer dynamic, i.e. video), text, and sound over the Internet is 

interfaces, and more particularly to human/computer inter- well-known, the transmission of other types of sensory data 

faces with force feedback that can operate over a network. has not been well explored. In particular, the transmission of 

The Intemet has, of late, become extremely popular. The data over the Internet pertaining to the sense of touch and/or 
origins of the Internet date back several decades to a U.S. force has not been established. "Force feedback" allows a 
government sponsored military/re search/business wide area user to experience or "feel" tactile sensations as provided 
network (WAN) that was designed to remain operational through computational information. Using computer- 
even in the event of the catastrophe, e.g. a major earthquake controlled actuators and sensors on a force feedback device, 
or a nuclear war. To accomplish this goal, robust protocols a variety of realistic sensations can be modeled and expe- 
and systems were developed which allowed a geographi- ^ rienccd by the user. This useful and highly immersive 
cally distributed collection of computer systems to be con- sensory modahty for interacting with the Interact has hereto 
nected as a WAN such that the loss of a particular computer, been unavailable, 
or group of computers, would not preclude the continued 

communication among the remaining computers. SUMMARY OF THE INVENTION 

While the use of the Internet has been prevalent for many ^ The present invention is related to the transmission of 

years now, its use has been limited by the arcane and difficult information pertaining to a subset of the sense of touch, i.e. 

commands required to access the various computers on the the transmission of forces to a user over a computer network 

network. To address this problem, a protocol known as the system. The "force feedback" provided by the methods and 

"World Wide Web" or "WWW" was developed to provide apparatus of the present invention enhance the sensory 

an easier and more user-friendly interface for the Intemet. experience of the user to provide a richer, more interesting, 

With the World Wide Web, an entity having a domain name and more enjoyable experience. 

creates a "web page" or "page" which can provide infor- ^ preferred method of the present invention for pro- 

mation and, to a Umited degree, some interactivity. ^i^ing force feedback over a network, a connection is first 

A computer user can "browse", i.e. navigate around, the 35 established between a server machine and a client machine. 

WWW by utilizing a suiUble web browser and a network The client machine (typically a personal computer), has a 

gateway (e.g., an Internet Service Provider PSP)). For visual display (e.g., a computer video monitor) and a force 

example, UUNET, America Online, and Global Village all feedback human/computer interface device. Examples of 

provide Internet access. Currently, the most popular web force feedback human/computer interfaces (hereafter "force 

browser, known as the Netscape® Navigator®, is made by 40 feedback devices") include force feedback joysticks, mice, 

Netscape Corporation of Mountain View, California. The trackbaUs, steering wheels, and yokes. In some embodi- 

web browser allows a user to specify or search for a web ments of the present invention, the force feedback device 

page on the WWW, and then retrieves and displays web preferably constrains movement to two degrees of freedom 

pages on the user's computer screen. to match a two-dimensional configuration of the visual 

The Internet is based upon a transmission protocol known 45 display. Three or more degrees of firecdom of movement can 

as "Transmission Control Protoool/Intemct Protocol" (or be provided in other embodiments. Next, the client machine 

"TCP/IP" for short), which sends "packets" of data between receives from the server machine both screen display infor- 

a host machine, e.g. a server computer on the Internet, and mation and force feedback information that is related to the 

a cHent machine, e.g. a user^s personal computer connected screen display information. Preferably, the screen display 

to the Internet. The WWW is an Internet interface protocol 50 information and force feedback information are encoded in 

which is supported by the same TCP/IP transmission pro- an HTML web page file. Files and data in other protocols or 

tocol. Intranets are private networks based upon Internet languages can also be used, such as VRML. Next, the client 

standards, and have become quite common for managing machine displays on the monitor an image generated from 

information and communications within an organization. the screen display information. The force feedback device 

Intranets, since they adhere to Internet standards, can often 55 provides a pointer event and/or a button event to the client 

use the same web browser software and web server software with respect to the screen image, and a force feedback signal 

as arc used on the Internet. is computed based upon the detected events and the force 

A web page typically includes static images and text. The feedback information stored on the client machine. Finally, 

images and text are specified in a "HyperText Mark-up a force feedback is provided to a user by the force feedback 

Language" ("HTML") file that is sent from the web server 60 device based upon the force feedback signal, 

to the cHent machine. This HTML file is parsed by the web Preferably, the force feedback device is provided with a 

browser in order to display the text and images on the local microprocessor which communicates with the client 

display of the cUent machine. Other standardized languages machine. The force feedback device further includes sensors 

or protocols are also being developed for use with the and actuators coupled to the local microprocessor such that 

Internet and the World Wide Web. For example, the Virtual 65 the force feedback signal can take the form of a relatively 

Reality Modeling Language (VRML) is used to provide high-level force feedback command. The local micropro- 

visual virtual 3-D environments and allow one or many cessor parses the force feedback command to control the 
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actuators of the human/computer interface in a coDtrol loop 
with the sensors. 

Another preferred method of the present invention for 
providing force feedback over a network establishes a 
connection between a first computer and a second computer 5 
over a network. The first computer includes a computer 
input device which develops a first computer input, and a 
second computer includes a visual display and a force 
feedback device for providing a second computer input. The 
computer input device of the first computer may or may not jq 
also be a force feedback device. A screen image is displayed 
on the monitor of the second computer that is associated 
with stored force feedback information. A computer input is 
received from the first computer over the network, and a 
force feedback signal, based on the stored force feedback 
information and upon at least one of the first computer input 
and the second computer input, is determined. Finally, a 
force feedback is provided with the force feedback device in 
response to the force feedback signal such that it is corre- 
lated with the screen image on the second computer. 

A preferred method of the present invention for providing 
force feedback over a network supporting TCP/IP protocols 
includes: (a) sending a connection request from a client 
computer over a network supporting TCP/IP protocols to a 
web server comiected to the network that is hosting a desired 25 
URL; (b) receiving, parsing, and interpreting (i.e. 
"processing") an HTML file at the client computer that was 
sent from the web server in response to the connection 
request, wherein the processing includes parsing an embed- 
ded force object reference having associated parameters and 30 
building a force object that is specified by the force object 
reference and the parameters; (c) developing a force feed- 
back signal from the force object; and (d) providing force 
feedback to a user of the force feedback device coupled to 
the client computer in response to the force feedback signal. 35 
Preferably, the HTML file is a web page of the web server 
and the parsing is provided by an enhanced web browser. 
Even more preferably, the web browser is provided with a 
software "plug-in" to aid in the processing of the embedded 
force object reference, the building of the force object, and 40 
the development of the force feedback signal. 

A network force feedback system in accordance with the 
present invention includes a network, a first computer 
coupled to the network, and a second computer coupled to 
the network, where the second computer includes a visual 45 
display and a force feedback device capable of providing a 
second computer input to the second computer, and further 
being capable of providing force feedback to a user in 
response to a force feedback signal provided by the second 
computer. Preferably, the force feedback device includes a 50 
local microprocessor that communicates with the second 
computer such that the force feedback signal can take the 
form of a relatively high-level force command. The second 
computer develops an image on the visual display that is 
correlated to stored feedback information, such that the 55 
second computer produces the force feedback signal in 
response to at least one of information provided firom the 
first computer and of the second computer input. The first 
computer can either be a server computer or, like the second 
computer, another client computer coupled to the network, eo 
The present invention therefore permits a computer user to 
experience force feedback over the network. 

In the network force feedback system, information per- 
taining to force feedback can be downloaded from a server 
computer to the second or "clienf * machine. Alternatively, 65 
force feedback signals can be sent over the network between 
a first "client" machine and a second "client" machine on a 
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peer-to-peer basis, or from a server to one or more peers in 
a server-to-peer basis. 

The present invention adds a new sensory modality when 
interacting with a networked computer system. More 
particularly, force information can be either downloaded to 
a client machine from a server machine connected to the 
network, or force information can be passed between two or 
more client machines on the network. When force informa- 
tion is downloaded from a server, the client machine parses 
and interprets the force information and directly controls its 
interaction with the force feedback device on an essentially 
real-time basis. In contrast, peer-to-peer or server-to-peer 
direct interaction over the network may be subject to some 
transmission ("latency") delays, but permits remote interac- 
tivity with a client's force feedback device. 

These and other advantages of the present invention will 
become apparent upon reading the following detailed 
descriptions and studying the various figures of the draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a pictorial representation of the Internet, a web 
server machine, and two client machines; 

FIG. 2 is a block-diagram of a client machine used in the 
present invention; 

FIG. 3 is a block-diagram of a force feedback system in 
accordance with the present invention; 

FIG. 4a is a perspective view of a preferred human/ 
computer interface ("force feedback device") of the present 
invention; 

FIG. 4b is a cross-sectional view taken along line 4b — 4b 
of FIG. 4a; 

FIG. 5a is a perspective view of another preferred 
embodiment for a force feedback device in accordance with 
the present invention; 

FIG. Sb is a perspective view of a first alternate embodi- 
ment for the force feedback device of FIG. 5a; 

FIG. 5c is a perspective view of a second alternate 
embodiment of the force feedback device of FIG. Sa; 

FIG. 6 is a block diagram of a wide area network (WAN) 
based upon Internet TCP/IP protocol and supporting World 
Wide Web (WWW) HTML protocols in accordance with the 
present invention; 

FIG. 7a is flow-diagram of a "Acquire URL" process in 
accordance with the present invention; 

FIG. lb is an example of an HTML file of the present 
invention sent from a web server machine to a client 
machine; 

FIG. 8 is a flow-diagram of the "Parse and Interpret 
HTML Component" step of FIG. la; 

FIG. 9 is a flow-diagram of the "Plug-in Interpret IFF 
File" step of FIG. 8; 

FIG. 9a is an illustration of an image displayed on a visual 
display of a client computer as generated from a downloaded 
HT^L web page file; and 

FIG. 10 is a flow-diagram of a process for monitoring the 
"pointer state" of the force feedback device of the present 
invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

In FIG. 1, a network system 10 includes a wide area 
network (WAN) such as the Internet 12, and a number of 
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computers or "machines" coupled to the Internet 12. For In FIG. 2, a "personal" computer 34 architecture that can 

example, a first client machine 14, a second client machine be used for client machine 14 or client machine 16 is shown 

16, and a web server machine 18, arc coupled to the Internet in block diagram form. It should be noted that a variety of 

12. machine architectures can be used to access the Internet 12, 

As noted previously, both the Internet 12 and Intranets 5 i-®- can be used as network access computers." The par- 
operate using the same TCP/IP protocols. This allows Intra- ticular architecture shown for the computer 34 is a typical 
nets to use similar or the same server machine software and personal or "PC computer architecture, such as that used 
client machine software as are used in Internet 12 applica- with IBM compatible personal computers. Web server 
tions. Therefore, it will be apparent to those skilled in the art machines can also have similar architectures, but arc often 
that the following descriptions apply equally well to more powerful computers known as "workstations" that 
Internet, Intranet, and other forms of network systems that operate under some variant of the UNIX® operating system, 
are compatible with the processes and apparatus disclosed The Internet service providers 20a are likewise often UNIX- 
herein. based computers or powerful personal computers running 

The Internet 12 includes a number of nodes 20 that are Windows NT®. The nodes 20 are most commonly routers 

interconnected by data transmission media 22. These nodes ^5 tiuilt by Cisco Systems of San Jose, Calif. Client machine 14 

are typically routers, switches, and other intelligent data or 16 can also take other forms, such as a television 

transmission apparatus which route "packets" of TCP/IP including or connected to a microrprocessor for Internet 

information to the desired destination. In some instances, the access. Force feedback devices used with such client 

nodes 20 comprise an Internet service provider (ISP) 20fl machines can be appropriate for the particular embodiment, 

which allows a client machine to access the "backbone" of ^ e.g., a TVremote control used for internet browsing on the 

the Internet. Alternatively, client machines and web servers abovementioned television can include force feedback func- 

can be coupled directly into the backbone of the Internet. tionality. 

As noted previously, the present invention is directed to The personal computer system 34 includes a micropro- 

the implementation of force feedback over a network, such cessor 36 clocked by a system clock CLK and which is 

as the Internet 12. To provide a user of a client machine with 25 ^^^Pl^d to a high speed or memory bus 38 and to a lower 

the experience of force feedback, force feedback human/ speed or I/O bus 40. The system RAM 42 and ROM 44 are 

computer interfaces (hereafter "force feedback devices") 24 typically coupled to the high speed memory bus, while 

and 26 can be provided as part of the client machines 14 and various peripherals, such as the video display, hard disk 

16, respectively. The client machines 14 and 16 are typically drive, Internet interface (often either a modem or an Ethernet 

provided with computer video monitors 28 and 30 (which is 30 connection), and force feedback device, are typically 

one example of a "visual display"), respectively, which can coupled to the slower 1/0 bus. The microprocessor executes 

display images 11 and 12, respectively. Preferably, forces programs stored in the various memories (RAM, ROM, hard 

developed by force feedback devices 24 and 26 are corre- disk, etc.) of the personal computer 34 to control, for 

latcd with the images II and 12 of the client machines 14 and example, the image display on the video display and the 

16, respectively. 35 forces provided by the force feedback device. The manu- 

The machines 14-18 are considered, in the language of facture and use of personal computers, such as personal 

the Internet, to be "resources," and each has its own unique computer 34, are well-known to those skilled in the art. 

Uniform Resource Locator or "URL." In one embodiment of 1° PIG. 3, a client machine 46 in accordance with the 

the present invention, a client machine, such as client present invention includes a personal computer system 48 

machine 14 or 16, sends a request for a "web page" residing 40 ^^^d a force feedback human/computer interface or "force 

on, for example, web server machine 18. This is accom- feedback device" 50. A user 52 can receive visual informa- 

plished by the client machine sending a connection request tion 54 and auditory information 56 from the personal 

and a URL which specifies the address of the web page to computer 48 and can manipulate the force feedback device 

the web server machine 18. The web server machine 18 then 50 as indicated at 58a and SSb to provide input, e.g., to 

sends a web page 32 written in HTML format back to the 45 command a cursor location on a visual display or other 

requesting client machine where it is "cached" in the provide other control information. In addition, the user 52 

memory (typically the RAM, hard disk, or a combination of can receive force feedback 60 from the force feedback 

the two) of the client machine. In this embodiment of the device 50 to represent physical "feel" sensations, 

invention, the image on the video display of the client The personal computer system 48 includes the micropro- 

machine is generated from the HTML web page file cached 50 cessor 36, the system clock 62, a video monitor 64 (which 

on the client machine, and force feedback is provided to a is one type of "visual display"), and an audio device 66. The 

user through the force feedback device as he manipulates a system clock 62, as explained previously, provides a system 

user manipulable object of the force feedback device. clock signal CLK to the microprocessor 36 and to other 

In another aspect of the present invention, a first client components of the personal computer system 48. The dis- 

machine, such as client machine 14, and a second client 55 P^ay device 64 and the audio output device 66 are typically 

machine, such as client machine 16, directly communicate coupled to the I/O bus 40 (not shown in this figure), 

force feedback commands to each other in standard TCP/IP In this preferred embodiment, the force feedback device 

protocol over the Internet 12. More particularly, client 50 preferably includes a local microprocessor 68, a local 

machine 14 can send force feedback and other information clock 70, optional local memory 71 for the local micropro- 

to the URL of the client machine 16, and the client machine 60 cessor 68, a sensor interface 72, sensors 74, a user manipu- 

16 can send force feedback and other information in stan- latable object 76, "other" input interface 78, an actuator 

dard TCP/IP packets to the URL of the client machine 14. In interface 80, a safety switch 82, and actuators 84 which 

this way, users of client machine 14 and client machine 16 provide a force F to the object 76, and an optional power 

can interact physically over the Internet 12. Of course, a supply 86 to provide power for the actuator interface 80 and 

server machine 18 can likewise directly communicate force 65 actuator 84. 

feedback commands to a client machine 12 or 14, or all three The microprocessor 36 of the personal computer system 

machines can interact. 48 is coupled for communication with the local micropro- 
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cesser 68 of the force feedback device 50, This communi- includes a shaft 90 and a ball-grip (or joystick) 92. The force 

cation coupling can be through a serial port coupling 88 to feedback device 50a also includes a pair of linear voice coil 

the personal computer system, or through a game port actuators ("voice coils") 94 and 96 that can serve both as 

coupling 90 to the personal computer system. Virtually all sensors and actuators. Alternatively, the voice coils can be 

personal computer systems built to the IBM PC/AT stan- 5 used only as actuators, and separate sensors (not shown) can 

dards will include a serial port and a game port. As noted, the be used. TTie voice coil 94 is coupled to the shaft 90 of object 

serial port will permit two-way communication between 76a by a first link 98 and a second link 100. link 98 is 

microprocessor 36 and microprocessor 38, and thus is prcf- coupled to link 100 with a pivot 102, and a link 100 is 

erable over the game port coupling which only permits coupled to the shaft 90 by a pivot 104. Similarly, voice coil 

one-way communication from the local processor 68 to the 96 is coupled to the shaft 90 of the object 76fl by a first Unk 

microprocessor 36. In consequence, a serial port connection 106 and a second link 108. The first link 106 is coupled to 

between the personal computer system 48 and the force second link 108 by a pivot 110, and the link 108 is coupled 

feedback device 50 will permit force feedback commands to to the shaft 90 of the object 76a by the pivot 104. 

be sent from the microprocessor 36 to the local micropro- The link 98 can move in and out of a housing 112 as 

cesser 68, while a game port connection alone will not be indicated by arrow 114, and link 106 can move in and out of 

able to provide this function. However, some simpler forms a housing 116 of voice coil 96 as indicated by the arrow U8. 

of "reflex" type force feedback can still be provided by the The pivots 102, 104, and 110 allow the object 76fl to move 

force feedback device 50 under the control of the local within the constraints of an x-y plane, but does not permit 

microprocessor 68 even ifonly a game port interface is used. movement in a z direction orthogonal to the x-y plane. 

It should also be noted that the microprocessor 36 and a local Therefore, the force feedback device is a two degree (2D) of 

microprocessor 68 can communicate over both the serial freedom device. That is, the user manipulatable object 16a 

port connection and the game port connection to provide a can move with a first degree of freedom in a x direction, and 

greater commuinication bandwidth. Apreferred serial port is in a second degree of freedom in the y direction. A 2D force 

the Universal Serial Bus (USB) of a personal computer, feedback device 50a is considered preferable in the present 

although an RS-232 serial bus, or other serial busses, a ^ invention since it correlates well to the two-dimensional 

parallel bus, an ethernet bus, or other types of interfaces or screen of a monitor of a client machine, 

communication links can also be used. in FIG. 46, a voice coQ 94 is shown in a cross sectional 

In use, the user 52 of the client machine 46 grasps the view taken along line 4/j — Ah of FIG. 4fl. The housing 112 

object 76 of the force feedback device 50 and manipulates includes a central core 120 and a number of elongated 

(i.e. exerts a force to move or attempt to move) the object to 3Q magnets 122. An armature 124 includes a hollow, cylindrical 

cause a "pointer" icon to move in the image displayed by the member having inner surface 126 which slidiogly engages 

display device 64. This pointer icon typically takes the fonn the core 120. Wrapped around the armature 124 are coils 

of a smaU arrow, a pointing hand, or the like. The sensor 75 128. The coils are electrically coupled to actuator and/or 

senses the movement of the object 76 and communicates the sensor interfaces. A plate 130 is attached to the end of the 

movement to the local microprocessor 68 through the sensor 35 armature 124 and is coupled to the link 98. The armature 124 

interface 72. The local microprocessor 68 then communi- and link 98 can move in a linear fashion as indicated at 114. 

cates through serial port 88, game port 90, or both to the Other voice coil configurations can also be used, such as 

microprocessor 36 to cause the microprocessor 36 to create differently shaped cores, different coil layouts, etc. 

a corresponding movement of the pointer icon on the image The force feedback devices of FIGS. 4a and 4b are also 

displayed upon the visual display 64. In some embodiments, ^ described in U.S. Pat. No. 5,805,140, the disclosure of which 

the sensors 74 can communicate direcdy to microprocessor js incorporated herein by reference. In particular, the opera- 

36 without the use of local microprocessor 68. The user can tion of the voice coils as actuators and/or sensors is 

also create other input, such as a "button click," through the described therein. 

other input 78 which are communicated to the microproces- 5^^ alternative embodiment of a force feedback 

sor 36 by the local microprocessor 68 or directly, e.g., using 45 device 506 is illustrated. The force feedback device 506 has 

a game port. many points of similarity with the force feedback device 

If the pointer icon on the display device 64 is at a position soa, with like reference numerals referring to like elements, 
(or time) that correlates to a desired force feedback to the The force feedback device 506 includes the user manipu- 
user 52, the microprocessor 36 sends a force feedback Utable object 76a, the shaft 90, the ball knob 92, and the 
command to the local microprocessor 68 over the serial port 50 voice coils 94 and 96. However, the links of the force 
connection 88. The local microprocessor 68 parses this force feedback device 50a have been replaced by flexure mem- 
feedback command and sends signals to the actuator inter- bers. More particularly, the links 98 and 100 of force 
face 80 which causes the actuator 84 to create forces F on feedback device 50a have been replaced by a rigid connector 
object 76, which are experienced by the user 52 as indicated 132 and a flexible member 134 (coUectively comprising a 
at 60, The safety switch 82, sometimes referred to as a 55 "flexure member"), and the links 106 and 108 of the force 
"deadman switch", blocks the signal from the actuator feedback device 50a have been replaced by a connector 
interface 80 if, for example, the user 52 is no longer grasping member 136 and a flexible member 138 (also collectively 
the object 76. In this way, the user 52 can interact with the comprising a flexure member). The connector 132 is rigidly 
client machine 46 in a visual, auditory, and tactile fashion. is attached to the plate 130 at the end of the armature of the 

The hardware architecture described above is also 60 voice coil 94 and is rigidly attached to an end of the flexible 

described in U.S. Pat. No. 5,739,811, the disclosure of which member 134. The other end of the flexible member 134 is 

is incorporated herein by reference. The high level command attached to a base 140 which, in turn, is rigidly attached to 

protocol between the computer and the force feedback the shaft 90 of the object 76a. Similarly, the connector 136 

device is also described in U.S. Pat. No. 5,734373, the is attached to a plate of an armamre of voice coil 96 at one 

disclosure of which is incorporated herein by reference. 65 of its ends, and is attached to the flexible member 138 at the 

In FIG. 4a, a force feedback device 50a is provided with other of its ends. The remaining end of flexible member 138 

a user manipulatable object 76a which, in this instance, is rigidly attached to the base 140. 
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The flexible members 134 and 138 serve the same fimc- As noted in FIG. 6, a client machine 14 can send a data 

tioDS as the links of the force feedback device 50fl described request to the server machine 18 and, in return, receive an 

previously. As the object 76a is moved back and forth along HTML web page file including a special file of the present 

an x-y plane, the flexible member 134 can move in and out invention known as an "IFF" file. As will be appreciated by 

of the voice coil housings 94 and 96, respectively, and can 5 those skilled in the art, the server must also have a modified 

bend to accommodate angular movement with respect to the configuration file which lets it know that IFF is a valid 

X and y axis. This permits the connectors 132 and 136 to MIME type. This modified file would be a SRM.CONF or 

move back and forth within the voice coils 94 and 96, other .CONF file. The client machine 14 then sends force 

respectively. The force feedback device of FIG. Sa is also feedback commands to the force feedback device 24 and 

describedinU.S.Pat. No. 5,805,140, the disclosure of which receives tracking and button data from the force feedback 

has been incorporated herein by reference. device 24. Client machine 16 can likewise send a data 

In FIG. Sb, an alternative user manipulatable object 76a request to the server machine 18 and receive an HTML file 

takes the form of a stylus 142 which can engage an aperture with one or more IFF files. The client machine 16 can then 

144 in an alternative base 140'. The alternative base 140' can interact with the force feedback device 26 by sending force 

be coupled to the flexible members 134 and 138 of the feedback commands to the device 26 and by receiving 

embodiment of FIG. 5a. Alternatively, the tip of stylus 142 tracking and button data from the force feedback device 26. 

can be rigidly or rotatably attached to alternative base 140' In addition to communicating with the server machine, 

with, for example, a ball joint or other joint or fastener. the client machines can communicate directly with each 

In FIG. 5c, another alternative base 140" is provided with other over the Internet using an Internet communication 

an enlarged aperture 144' which can be engaged by the tip 20 protocol. For example, client machine 14 can communicate 

of a finger 146 of the user. The base 140" then becomes the with client machine 16 through a TCP/IP connection. This is 

user manipTilatable object 76c. As before, the base 140" is accomplished making the URL of the client machine 16 

coupled the flexible members 134 and 138 of the first known to the client machine 14, and vice versa. In this 

feedback device 50b of FIG. 5a. The structures of FIGS. 5^> fashion, direct communication between client machines can 

and 5c are also described in U.S. Pat. No. 5,721,566, the 25 be accomplished without involving the server machine 18. 

disclosure of which is incorporated herein by reference. These connections can send force feedback information and 

The embodiments of FIGS. 55 and 5c illustrate two of a other information to the other client machine. For example, 

range of equivalent user manipulatable objects suitable for a process on the client machine 16 can send force feedback 

the present invention. It should be apparent to those skilled information over a TCP/IP Internet coimection to the client 

in the art that these alternative objects 16b of FIG. Sb and 30 machine 14, which will then generate a force feedback 

76c of FIG. 5c can equally well be used with other force command to the force feedback device 24. When the user 

feedback devices, such as the force feedback device 50a reacts to the force feedback at force feedback device 24, this 

illustrated in FIG. 4a. information can be sent from client machine 14 to client 

As noted previously, a preferred embodiment of the machine 16 to provide force feedback to the user on force 

present invention provides a user manipulatable object that 35 feedback device 26. 

has two degrees of freedom. Other user manipulatable In FIG. 7a, a flow diagram illustrates an "acquire URL" 

objects having one degree of freedom or three or more process 146 running on a client machine, such as client 

degrees of freedom are also within the scope of the present machine 14 or client machine 16. This process 146 is 

invention. For example, one embodiment of the present preferably implemented using a standard Internet browser 

invention provides only one degree of freedom. Other force 40 with a "plug-in" extension which permit the handling of 

feedback devices of the present invention include mice, force feedback commands. A preferred browser software is 

joysticksjoypads, a steering wheel, and yolks having two or Netscape Navigator® software available from Netscape 

more degrees of fireedom. Corporation of Mountain View, Calif. The plug-in software 

In FIG. 6, a conceptual representation of the network ^ a proprietary extension of the web browser software, 

system 10 with force feedback includes a server machine 18, 45 where this proprietary extension was developed by the 

a client machine 14 provided with a force feedback device Applicant of the present application. 

24, and one or more additional client machines 16, each of The process 146 begins at 148 and, in a step 150, a 

which may be provided with additional force feedback connection request is sent to the "host" of the desired URL. 

devices 26. As noted in this figure, the server machine is a The host, in this example, is a server machine 18 and the 

computer or "processor" running, for example, the TCP/IP 50 desired URL is the URL of the desired web page residing 00 

server software and is which is connected to the Internet. the server machine 18, the web page including force fced- 

The client machine 14 includes a computer or "processor" back commands. Alternatively, the desired web page can 

running Internet browser software and force feedback driver reside on another server or resource and be retrieved by 

software. The processor of the client machine is connected server machine 18. Id response to the connection request of 

to the Internet and to the force feedback device 24. The force 55 step 150, the server machine 18 sends the HTML file 

feedback device 24 has sensors and actuators so that it can representing the web page over the Internet to be received by 

track movement of the user manipulatable object, monitor the client machine. The HTML file includes a number of 

for button presses and/or other ancillary input devices, and "components" which arc typically commands, command 

provide output force feedback sensations. The force feed- fragments, instructions, and data which permit the display of 

back device 24 sends object tracking information to the 60 the web page and other web browser functionality. In a step 

client machine, and receives force feedback commands from 154, and an HTML component is obtained. If this compo- 

the client machine 14. The "additional client", such as client nent is the end of file ("eof a step 156 detects that fact and 

machine 16, also includes computers or "processors" run- the process is completed at 158. Otherwise, the HTML 

ning Internet browser software and force feedback driver component is parsed and interpreted at a step 160 and 

software. The processors of these additional clients are also 65 process control is returned at step 154. 

connected to the Internet and are connected to force feed- It should be noted that most web browser software will 

back devices associated with that client. start parsing and interpreting (i.e. processing) the HTML 
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components even before the entire HTML file is received at 
the client machine. Alternatively, the entire HTML file can 
be received before the processing begins. 

In FIG. 7b, an example of an HTML web page 32, sent 
from a web server machine 18 to a client machine (such as 5 
client machine 14 or 16) over the Internet 12, is shown. The 
HTML file 32 includes a number of "components" which are 
parsed and interpreted as previously described. An HTML 
file begins with a <HTML>command 162 to indicate the 
start of the HTML file, and a <BODY> command 164 to 
indicate that the body of the HTML file is beginning. Then, 
an arbitrary number of HTML commands 166 are provided 
to, for example, display images of the web page on the video 
display of the client machine. A <CENTER> command 168 
wiU cause a centering of following objects with respect to ^5 
the browser window on the video display of the client 
machine. Next, an <EMBED . . . > command 170 of the 
present invention defines a force button object that will be 
displayed on the client machine. Since the <CENTER> 
command 168 was given just prior to the <EMBED . . . > 20 
command, this "force button" wUl be centered in the dis- 
played browser window. Other force objects besides button 
objects can also be defined and displayed, such as links, text, 
sliders, game objects (balls, paddles, etc.), avatars, windows, 
icons, menu bars, drop-down menus, or other objects. 25 

In a first hne 172 of the <EMBED . . , > command, the 
force button object is defined by a "IFF" extension file, 
namely "FORCEBUTTON.IFF." Next, in a line 174, the size 
of the button is indicated to be 100 pixels by 100 pixels. In 
a Hne 176, the initial state of the button is indicated to be 30 
"up" (i.e., unselected), and a hne 178 defines the force effect 
to be "vibration." A number of parameters 180 defining the 
character and nature of the vibration are also provided (start 
time, length, frequency, magnitude, etc.). In a line 182, the 
"trigger" for the force effect is given by the function 35 
"MOUSEWITHIN" with its associated parameters, and by 
the function "BUTTONSTATE." The function MOUSE- 
WITHIN determines whether the pointer icon, the position 
of which is controlled by the force feedback device, is within 
the specified boundaries defining a region of the force 40 
button. This region can be specified by the parameters and, 
for example, can be defined as the exact displayed area of the 
button, or can be defined as a sub-region within the button 
that is smaller than the displayed size of the button. The 
function BUTTONSTAIE determines whether a button or 45 
switch of the force feedback device is in the desired state to 
trigger the force object event (e.g., a button event in this 
example). In a line 184, the icon representing the force 
button is specified as "LOUIS.GIF," and the text associated 
with the button is defined as "Hi, Vm Louis" in a line 186. 50 
The font of the text is given as "Helvetica" in a line 188. 
Other force efiEects, triggers and parameters can also be 
associated with the force object. For example, a force (such 
as a vibration) can be triggered if the pointing icon is moved 
a predetermined velocity or within a predefined range of ss 
velocities within the force object. Or, a trajectory of the 
pointing icon on a force object can trigger a force, like a 
circle gesture. 

The <EMBED . . . > command is an existing functionality 
of HTML. It essentially embeds function-calls which are 60 
handled by the web browser. If the suffix of the specified file 
is a known, standard suffix type, the call is executed directly 
by the web browser. If, however, the suffix (.IFF in this 
instance) is not a standard feature of the web browser, the 
browser will first look for a "plug-in" to implement this 65 
feature and, if a suitable plug-in is not found, it will look for 
application programs implementing this feature. In the pre- 
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ferred embodiment of the present invention, a plug-in 
including a reference to a Dynamically Linked Library 
(DLL) is provided to give functionality to the .IFF suffix. 
The DLL can be provided local to the client machine or on 
another linked resource. 

With continuing reference to FIG. 7b, the centering com- 
mand is terminated at line 190 with the </CENTER> com- 
mand. Additional HTML commands 192 can then be 
provided, and the body of the HTML file is terminated by the 
</BODY> command 194. The end of the HTML file is 
indicated at 196 with the </HTML> command, i.e. this 
command 196 is the "eof ' command of the HTML file 32. 

The present invention also provides for programm ability 
of the embedded force feedback object. An example of this 
programmability is shown at 198. This optional program- 
mable command can be inserted into the EMBED command 
170 and can include, for example, an iterative loop. In line 
200, a "FOR^' command initializes a counter i to 0, indicates 
that the counter I is incremented by one per each pass 
through the loop, and it indicates that the loop should be 
completed five times, i.e. while i<5. The body of the loop 
includes a command line 202 which indicates that a force 
feedback "vibrate" with associated parameters should be 
evoked, and a line 204 indicates that a 5 second wait should 
be provided after the vibration has occurred. This step will 
repeat five times, i.e. the command 198 will cause five 
vibration sequences separated by four 5 second pauses, and 
followed by a final 5 second pause. By providing program- 
mability to the force feedback object, force feedback effects 
based upon past events and upon a complex interaction of 
factors can be provided. 

In FIG. 8, the "Parse And Interpret HTML Component" or 
simply "Process HTML Component" step 160 of FIG. 7a is 
illustrated in greater detail. In FIG. 8, process 160 begins at 
206 and, in a step 208, it is determined whether there is an 
embedded "tag** for a force object, e.g. a tag having an .IFF 
reference. An example of the embedded tag is shown at the 
EMBED command 170 of FIG. 7b. If there is such a tag, step 
210 uses the plug-in software of the present invention to 
interpret the IFF file, and the process is completed at 212. 
Otherwise, another type of HTML command has been 
encountered, and the standard web browser parser and 
interpreter processes this HTML component in a step 214, 
after which the process is completed at 212. 

In FIG. 9, the step 210 "Plug-In Interprets IFF File" of 
FIG. 8 is described in greater detail. Process 210 begins at 
216, and in a step 218, a "framework" is created for the force 
object. The framework provides a particular set of generic 
features to implement the specified force object, and pref- 
erably includes no specific parameters or functions for the 
force object. Next, ki a step 220, the name/value pairs are 
parsed and, in a step 222, the force object is built upon this 
framework based upon the nameA'alue pairs. A name/value 
pair includes the name of a component and its associated 
parameters. For example, one name might be "BUTTON- 
STATE" and its value (or parameter) might be "UF* (or 
"UNSELECTED"). The process 210 is completed at 224. 

In FIG. 9a, an image 226 to be displayed on a screen of 
a video monitor or other visual display is illustrated. More 
specifically, image 226 can be generated by the popular 
Netscape Navigator® web browser. The image 226 includes 
a window 228 including a header portion 230 and a body 
portion 232. The header portion 230 includes a number of 
navigation buttons 234 and special purpose buttons 236 for 
purposes well-known to those familiar with the Netscape 
Navigator web browser. In addition, the header portion 230 
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displays the URL of the currently displayed web page at 238. will cause a "detent" to be created for the force feedback 

In this instance, the URL is "http://www.immerse.com/ device. By "detent" it is meant that the user manipulatablc 

demo. "The images displayed within the body portion 232 of object will be controlled by the force feedback actuators 

the window 228 are created by the aforementioned process- such that it feels as if a mechanical-type detent exists at the 

ing of the HTML file by the web browser. 5 position that the user manipulatable object was in when the 

The area within the body portion 232 has been provided detent button 268 was activated, 

with a number of regions and buttons to illustrate some of jhese and other forces resulting from a pointing icon 

the concepts of the present mvenUon. The force feedback interacting with various objects displayed on a computer 

device controls the position of a pointer icon 240 which can ^^^en are also described in co-pending patent application 

be caused to interact with the various regions and buttons. 10 Ser. No. 08/571,606 filed Dec. 13, 1995, Atty. Ref. 

As an example, when the force feedback device is manipu- IMM1P015, the disclosure of which is incorporated herein 

lated by the user to cause the pointer icon 240 to move reference. 

within a "texture" region 242, force feedback commands can , ™^ ^„ r ^1. 1 • r 

. i J r it. r r 1 J - * j j - j l^ I'l^J- 10, a orocess 270 or the plue-m software oi the 

be created for the force feedback device to provide a desired , . r™ » 

* » * *u r ju 1 J • 1- 1 .t- present invention is illustrated. The process 270 begins at 

texture to the force feedback device. For example, the 15 . • , ^-^ _« l . . r.L 

. ^ r 1 « !.» * I- • c 272 and, m a step 274, the position and button state of the 

texture can feel rough to the user by causme the force ^ r j. 1 1 • • . kt . • . 

f.. ij. , , c -1*1-1 lorce reedback device is monitored. Next, m a step 276, a 

feedback device to place forces on the user manipulatable - r j. 1 j - . j ■ ... 

object that emulate a rough or bumpy surface. In a region ^'.^'^^^'^ ^ ^"P°°^^ .'° 

244, a "viscosity" force feedback can be provided. With this ^^'""^'^ ^TTt'^ f f " "^'"f'/it T"!"^ V p ^ 
e CP p I 4U • * • • J *u u Dynamically Linked Library (DLL) to place a force feed- 
form of force feedback, as the pointer icon is moved through 20u i J *x. ' , ic L' X. L J J 
field 244, a viscous "drag" force is emulated on the u^r ^^f^ Ti°if°i°? • Parsed and 
manipulatable object. In a region 246, inertial forces can be "^''H'rctcd by the force feedback device. The process is then 
pn-Tup '. u- j»u u completed as indicated at 280. 
telt. Ineretore, a pointer icon being moved through an ^ 

"inertia" region would require relatively little or no force to ^^^^ ^^^^ feedback driver (browser 
move in a straight line, but would require greater forces to 25 P^"^"'" ^^^^ ^^^^^^ "'^^'^''^ "^'^^ 
accelerate in a new direction or to be stopped. The inertial ^^^^ embodiment, the plug-in reads and executes 
force sensations can be appHed to the user manipulatable commands using the browser's run-time JAVA inter- 
object and felt by the user. In a "keep out" region 248, the P^^"^- optionally be used to make "aplets" which 
pointer image is prevented from entering the region. This is P^^^^"" Aynzmic models, such as creating complex force 
accomplished by creating a repulsive force on the user 30 f®^^^^'^ sensations. 

manipulatable object using a force feedback command to the should also be noted that the force feedback device 

force feedback device which prevents or inhibits the user itself can have a JAVA interpreting chip on board, permitting 

from moving the user manipulatable object in a direction of the plug-in driver to download JAVA code to the force 

the region 248 when the pointer icon 240 contacts the feedback device to be executed on the device. JAVA and 

periphery of the region 248. In contrast, a "snap -in" region 35 JAVA interpreting chips are available under license from 

250 will pull a pointer icon 240 to a center 252 whenever the SUN Microcomputers of Mountain View, California, 

pointer icon engages the periphery of the snap-in region 250 Furthermore, the force feedback driver (browser plug-in 

and apply a corresponding attractive force on the user or DLL) can have the ability to interact with instructions 

manipulatable object, A "spring*' region 243 emulates a provided in other languages besides HTML. For example, 

spring function such that a pointer icon moving into the 40 virtual reality 3-D graphical environments are increasingly 

spring region "compresses" a spring, which exerts a spring being created and implemented over the World Wide Web 

force on the user manipulatable object which opposes the and Intemet using languages such as the Virtual Reality 

movement of the pointer icon. A region 256 is a "Force To Modeling Language (VRML) and software such as Active X 

Left" region where the pointer icon within the region 256 is available from Microsoft Corporation. In these 3-D graphi- 

forced to the left side of the region and the user manipulat- 45 cal environments, users may interact with programmed 3-D 

able object is forced in a corresponding direction as if objects and constructs using client computer 14 or 16, and 

influenced by some invisible magnetic force or gravitational may also interact with 3-D graphical representations (or 

force. A region 258 illustrates that regions can be of any size "avatars") controlled by o±er users over the World Wide 

or shape and that within a region different force effects can Web/Intcrnct from other client computers. Force feedback 

be developed. In this example, within region 258 there is a 50 commands and parameters can be provided in the instruc- 

texture core 260 surrounded by a vibration ring 262, tions or files of these other protocols and languages and 

Therefore, as the pointer icon 240 moves into the region 258, received by a client computer system in an equivalent 

the user first experiences vibration from the ring 262, and manner to that described above so that force feedback can be 

then experiences a texture as the pointer icon moves within experienced in simulated 3-D space. For example, embed- 

tiie core 260. 55 ded force feedback routines can be included in the VRML 

The exemplary force feedback web page of FIG. 9a is also data for a virtual environment so that when the user moves 

provided with several force feedback buttons. In a first into a virtual wall, an obstruction force is generated on the 

button 264, the placement of the pointer icon 240 over the user-manipulatable object. Or, when the user carries a virtual 

button and the pressing of a button (i.e., a switch) on the object in a controlled virtual glove, the user might feel a 

force feedback device to create a "button click", "button 60 simulated weight of the virtual object on the user manipu- 

down", or simply a "button event" input, will then cause a latable object. In such an embodiment, the force feedback 

"buzz" command to be sent to the force feedback device. device preferably provides the user with three or more 

The buzz command would, for example, cause a vibration degrees of freedom of movement so that input in three 

force on the user manipulatable object. Similarly, the selec- dimensions can be provided to the client computer, 

tion of the "jolt" button 266 will cause a jolting force (e.g., 65 While this invention has been described in terms of 

a short-duration pulse of force) to be provided at the force several preferred embodiments, there are alterations, 

feedback device, and the pressing of the "detent" button 268 permutations, and equivalents which fall within the scope of 
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this invention. It should also be noted that there are may 
alternative ways of implementing both the process and 
apparatus of the present invention. It is therefore intended 
that the following appended claims be interpreted as includ- 
ing all such alterations, permutations, and equivalents as fall 
within the true spirit and scope of the present invention. 
What is claimed is: 

1. A computer-readable medium including program 
instructions for implementing force feedback over a 
network, the program instructions performing acts compris- 
ing: 

causing a connection to be established between a server 
machine and a client machine over a network, said 
client machine including a visual display device and a 
force feedback device providing computer-controlled 
physical force feedback to a user of said force feedback 
device; 

receiving from said server machine over said network 
web page information, said web page information 
includling screen display information representing a 
visual layout of a web page and force feedback infor- 
mation related to said visual layout of said web page; 

causing a display of said web page based upon said screen 
display information, said display provided on said 
visual display device of said client machine; 

receiving input information from said force feedback 
device for positioning a pointer image with respect to 
said visual layout of said web page; and 

causing a force feedback signal to be output to said force 
feedback device, said force feedback signal based upon 
said input information and based upon said web page 
information received over said network, wherein said 
force feedback signal causes said force feedback device 
to output computer-controlled physical force feedback 
to said user correlated with said visual layout of said 
web page on said visual display device, said force 
feedback being based at least in upon said force - 
feedback signal. 

2. A computer-readable medium as rcdted in claim 1 
wherein said server machine is a web server, said client 
machine is a network access computer. 

3. A computer-readable medium as recited in claim 2 
wherein said web server and said network access computer 
communicate over said network using TCP/IP protocols. 

4. A computer-readable medium as recited in claim 2 
wherein said input information includes information repre- 
senting a button click of said force feedback device, said 
button cUck information affecting said force feedback. 

5. A computer-readable medium as recited in claim 3 
wherein said force feedback device includes a user manipu- 
latable object having at least two degrees of freedom. 

6. A computer-readable medium as redtcd in claim 5 
wherein said force feedback information includes com- 
mands for providing said physical force feedback with said 
force feedback device. 

7. A computer-readable medium as recited in claim 5 
wherein said force feedback device is provided with a local 
microprocessor which communicates with said network 
access computer, said force feedback device including sen- 
sors and actuators coupled to said local microprocessor, and 
wherein said force-feedback signal is a force feedback 
command, said method further comprising: 

parsing said force feedback command on said local micro- 
processor to control said actuators of said force feed- 
back device in a control loop with said sensors of said 
force feedback device. 
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8. A computer-readable medium as recited in claim 5 
further comprising: 

developing on said server machine an HTML file includ- 
ing said screen display information and said force - 
5 feedback information. 

9. A computer-readable medium as recited in claim 8 
wherein said HTML file includes an embedded reference 
that can be used to create a force feedback object on said 
client machine, said force feedback object including infor- 

10 mation characterizing forces output by at least one actuator 
included in said force feedback device, the program instruc- 
tions further performing: 
parsing on said client machine said HTML file and 
creating on said client machine said force feedback 
object. 

10. A computer-readable medium as recited in claim 9 
wherein said causing a force feedback signal to be output 
includes: 

monitoring for said input information from said force 
feedback device; and 

using said force feedback object and said input informa- 
tion to provide said force feedback signal. 

11. A computer-readable medium as recited in claim 5, the 
^ program instructions further performing: 

developing on said server machine a VRML file including 
said screen display information and said force - 
feedback information. 

12. A computer readable medium as recited in claim 11 
30 further comprising using said input information from said 

force feedback device to allow said user to move a different 
object in 3-D space described by said VRML file. 

13. A computer-readable medium as recited in claim 1 
wherein said server machine is a web server, said client 

35 machine is a first network access computer, and further 
comprising a second network access computer coupled to 
said network, said second network access computer includ- 
ing a visual display device and a force feedback device, 
wherein said web server, said first network access computer, 

40 and said second network access computer can communicate 
with said network using TCP/IP protocols. 

14. A computer- readable medium as recited in claim 13 
wherein said input information allows said first network 
access computer to position a pointer image with respect to 

45 said web page on said visual display of said first network 
access computer, said input information including button 
information representing a button click of a force feedback 
device of at least one of said first network access computer 
and said second network access computer. 
50 15. A computer readable medium as recited in claim 1 
wherein said program instructions implement a network 
browser program. 

16. A method for providing force feedback over a network 
supporting TCP/IP protocols comprising: 
55 causing a sending of a connection request from a client 
computer over a network supporting TCP/IP protocols 
to a web server connected to said network that is 
hosting a desired URL; 
receiving and parsing an HTML file at said cHent 
60 computer, said HTML file including a web page of said 
web server, said HTML file being sent from said web 
server in response to said connection request, wherein 
said parsing includes: 

parsing a force object reference included in said HTML 
65 file and having associated parameters; and 

building a force object based on said force object 
reference and said associated parameters; and 
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causing a force feedback signal to be developed and sent 
to a force feedback device coupled to said client 
computer, said force feedback signal being developed 
using said force object, wherein physical force feed- 
back is provided to a user manipulatable object of said 5 
force feedback device in response to said force feed- 
back signal, said force feedback being generated by at 
least one actuator included in said force feedback 
device. 

17. A method for providing force feedback over a network lo 
supporting TCP/IP protocols as recited in claim 16 wherein 
said force object is built using information stored on said 
chent machine in addition to using said force object refer- 
ence and said associated parameters. 

18 . A method for providing force feedback over a network 15 
supporting TCP/IP protocols as recited in claim 17 wherein 

a network browser is provided on said client computer to 
perform said parsing and developing said force feedback 
signal. 

19. A method for providing force feedback over a network 20 
supporting TCP/IP protocols as recited in claim 18 wherein 
said network browser is provided with a plug-in for said 
parsing of said embedded force object reference and build- 
ing said force object, and to aid in said development of said 
force feedback signal. 25 

20. A method for providing force feedback over a network 
supporting TCP/LP protocols as recited in claim 19 wherein 
said force feedback device is provided with a plurality of 
actuators, at least one sensor, and a local microprocessor that 
commimicates with said client computer, and wherein said 30 
force feedback signal is a force feedback command sent 
from said client computer to said force feedback device, and 
further comprising: 

parsing on said local microprocessor said force feedback 
command to control said actuators in a feedback loop 
with said sensors. 

21. A method for providing force feedback over a network 
supporting TCP/IP protocols as recited in claim 20 wherein 
said local microprocessor can interpret JAVA instructions 
sent from said client computer, ^ 

22. A method for providing force feedback over a network 
supporting TCP/IP protocols as recited in claim 20 wherein 
said force object is a graphical object having associated 
forces, said force object being one of a link object, text 
object, slider object, window object, icon object, and drop- 
down menu object. 

23. A force feedback device coupled to a host computer, 
said force feedback device providing force feedback from 
information received over a network, the force feedback 
device comprising: 50 

a user manipulatable object physically contacted and 
manipulated by a user and moveable in a degree of 
freedom; 

an actuator for outputtiog forces on said user manipulat- 
able object in said degree of freedom; 

a sensor for detecting a position of said user manipulat- 
able object in said degree of freedom, a representation 
of said position being provided to said host computer to 
control a cursor displayed by said host computer; and gQ 

a local microprocessor, separate from and communicating 
with said host computer, and coupled to said actuator 
and said sensor, said local microprocessor interpreting 
force feedback commands received from said host 
computer, said force feedback commands coordinating 65 
a force to be output by said actuator with cursor 
interaction with a displayed element on a web page 
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displayed by said host computer, wherein said force 
feedback commands and said displayed element are 
derived from said information received by said host 
computer from a different computer over said network. 

24. A force feedback device as recited in claim 23 wherein 
said force output by said actuator is based at least in part on 
a position of said user object in said degree of freedom. 

25. A force feedback device as recited in claim 23 wherein 
said information has been received by said host computer 
from a server machine connected to said network. 

26. A force feedback device as recited in claim 23 wherein 
said server machine and said host computer communicate 
over said network using TCP/IP protocols. 

27. A force feedback device as recited in claim 23 wherein 
said force feedback command designates a type of force 
sensation to output using said actuator. 

28. A force feedback device as recited in claim 23 wherein 
said local microprocessor parses said force feedback com- 
mand to control said actuator in a control loop with said 
sensor. 

29. A force feedback device as recited in claim 23 further 
comprising a button input device having a state responsive 
to manipulation by said user, wherein said state of said 
button input device is provided to said local microprocessor 
and from said local microprocessor to said host computer. 

30. A force feedback device as recited in claim 23 wherein 
movement of said user manipulatable object is used to 
control a position of said cursor displayed on said web page. 

31. A force feedback device as recited in claim 30 wherein 
said user manipulatable object is constrained to move in two 
planar degrees of freedom, wherein said actuator is a first 
voice coil actuator, and further comprising a second voice 
coil actuator, wherein said cursor is controlled by said user 
manipulatable object to select said displayed element on said 
web page. 

32. A force feedback device as recited in claim 23 wherein 
said host computer monitors for said position of said user 
manipulatable object, and wherein said position is used to 
provide said force feedback command to said local micro- 
processor. 

33. Computer instructions embodied on a computer- 
readable medium for providing force feedback over a 
network, said computer instructions performing: 

causing a connection request to be sent from a client 
machine to a server machine over a network, said client 
machine including a visual display and a force feed- 
back interface device providing computer-controlled 
force feedback to a user of said force feedback interface 
device using at least one actuator; 

receiving web page information from a server machine 
over a network, said web page information including 
screen display information representing a visual layout 
of a web page and force feedback information related 
to said visual layout of said web page information, 
wherein said web page is displayed on a client machine 
based upon said screen display information; 

parsing a component from said received web page infor- 
mation; and 

providing said component to a force feedback interpreting 
process if said component is a force feedback 
component, wherein said force feedback interpreting 
process instructs said force feedback device to output a 
physical force based on an interaction of a user- 
controlled pointer with objects displayed on said web 
page. 

34. Computer instructions as recited in claim 33, wherein 
said web page information includes an HTML file, and 
wherein said component is an HTML component. 
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35. Computer instructions as recited in claim 33 wherein 
said force feedback interpreting process includes a plug-in 
extension. 

36. Computer instructions as recited in claim 33 wherein 
said force feedback interpreting process creates a force 
object including parameters intepretcd from said force feed- 
back component. 

37. Computer instructions as recited in claim 33 further 
comprising interpreting said parsed component if said com- 
ponent is not a force feedback component. 

38. A method for implementing force feedback over a 
network, the method comprising: 

causing a connection to be established between a server 
machine and a cHent machine over a network, said 
client machine including a visual display device and a 15 
force feedback device providing computer-controlled 
physical force feedback to a user of said force feedback 
device; 

receiving from said server machine over said network 
web page information, said web page information ^ 
including screen display information representing a 
visual layout of a web page and force feedback infor- 
mation related to said visual layout of said web page; 

causing a display of said web page based upon said screen 
display information, said display provided on said 
visual display device of said client machine; 
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receiving input data derived from input information from 
said force feedback device for positioning a user- 
controlled graphical object with respect to said visual 
layout of said web page; and 

causing a force feedback signal to be output to said force 
feedback device, said force feedback signal based upon 
said input data and based upon said web page infor- 
mation received over said network, wherein said force 
feedback signal causes said force feedback device to 
output computer-controlled physical force feedback to 
said tiscr correlated with said visual layout of said web 
page on said visual display device, said force feedback 
being based at least in part upon said force-feedback 
signal. 

39. A method as recited in claim 38 wherein said web page 
includes a two-dimensional visual layout, and wherein said 
input data causes said user-controlled graphical object to 
select a different displayed object in said visual layout 

40. A method as recited in claim 38 wherein said web page 
includes a 3-D environment, and wherein said input data 
causes said user-controlled graphical object to move a 
different displayed object in said 3-D environment. 
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